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On  the  Probability  Density  of  Signal-to-Noise  Ratio 
in  an  Improved  Adaptive  Detector 

Ivars  Kirsteins 
Donald  W.  Tufts 

Department  of  Electrical  Engineering 
University  of  Rhode  Island 
Kingston,  R.I.  02881 

Abstract 

We  derive  an  approximate  probability  distribution  for  the  SNR  (signal- 
to-noise  ratio)  of  an  improved  adaptive  detector  in  near  rank-1  gaussian 
noise  where  the  filter  weights  are  computed  using  the  principal  eigenvectors 
of  the  estimated  noise  covariance  matrix  .  The  noise  consists  of  two 
components,  a  strong  rank- 1-covariance  interference  component  plus  white 
noise.  Computer  simulation  is  used  to  verify  the  approximating  SNR 
distribution  and  show  that  it  is  accurate  even  for  small  sample  size  and  low 
interference-to-noise  ratios  (INR). 

We  use  this  distribution  to  show  the  improvement  possible  when  using 
filter  weights  based  on  just  the  principal  eigenvectors  rather  than  the  full 
inverse  of  the  estimated  sample  covariance  matrix  when  the  noise  covariance 
is  near  rank  1  .  For  example  we  compare  the  expected  value  of  SNR  for  our 
improved  method  and  the  conventional  adaptive  detector  based  on  the  inverse 
of  the  estimated  covariance  matrix.  We  find  that  for  twenty-five  samples  of 
data  and  an  INR  value  of  10  dB  ,  the  expected  value  of  SNR  for  our  new 
method  is  better  than  the  comparison  method.  Other  statistics  can  also  be 
obtained  from  the  probability  density. 

The  main  advantage  of  our  principal-component  method  of  adaptive 


method  based  on  the  inverse  of 


detection,  in  comparison  with  the 
estimated  covariance  matrix,  is  that  much  less  data  is  required  to  produce 
given,  needed  level  of  SNR  with  high  probability. 


CHAPTER  ONE 


(A)  Introduction 

(Al)  Detection  with  Known  Covariance 

Let  us  consider  the  problem  of  detecting  a  signal  in  gaussian  noise 
where  both  signal  and  noise  are  assumed  to  be  real  valued,  the  two 


hypotheses  are 

H0:  x  =  n  (noise  only) 

(1.00) 

H^:  x  =  n  +  s  (signal  present) 

(1.01) 

where  x  is  the  vector  of  the  observed  data;  n  is  a  zero-mean  gaussian 

T 

random  vector  with  covariance  matrix  E(nnA)  =  N  ;  and  s  is  the  signal 
to  be  detected*  The  dimensions  of  x,  n,  and  s  are  pxl. 


Under  these  conditions  it  can  be  shown 

that  a  likelihood  ratio 

test  statistic  [4]  is 


i  =  iT  N  1s 

(1.02) 

Equivalently,  the  test  statistic  z  can  be  considered  as  the  inner 


product  of  x  and  weight  vector  w. 

H 

II 

H 

(1.03) 

where  w  =  N  ^s. 

(1.04) 

Brooks  and  Reed  [4]  have  shown  that  selecting  a  weight  vector 
according  to  formula  (1*04)  is  the  same  as  maximizing  the  signal-to- 
noise  ratio  (SNR).  We  can  express  this  as  maximizing  the  quadratic 


rat  io 

T  T 

SNR  =  -W  SS  W 
w  Nw 

(1.05) 

The  weight  vector  that  maximizes  this  ratio  (see  [1,2,4])  is 


w  =  N  *s 

(1.06) 

The  maximum  SNR  is 

1 


(1.07) 


SNB».x  -  sTn'1s 

(A2)  Standard  Adaptive  Detection  with  Unknown  Covariance 
In  practice  we  do  not  know  the  noise  covariance  matrix  and  so  it  is 
usually  estimated  from  the  data.  The  maximum-likelihood  estimate  of 
the  noise  covariance  matrix  [7]  is 
K 

N  =  -4“  ^  n  n-T  (1.08) 

K  L  j  j 

j=l 

where  the  observed  noise  vectors,  nj  ,  are  pxl  vectors  which  are 
mutually  independent  and  gaussian  distributed  with  zero  mean  and 
covariance  matrix  N.  Following  standard  methods  one  can  obtain  an 
estimate  of  the  weight  vector  by  inverting  the  sample  covariance  matrix 
[1,2,3]  as  follows: 

w  =  N-1s  (1.09) 

To  measure  the  effectiveness  of  this  estimate  of  w  [1],  we  can  use  a 
normalized  SNR  which  is  formed  by  (a)  replacing  w  by  w  in  formula 
(1.05)  and  (b)  dividing  by  the  maximum  SNR  value  of  formula  (1.07)  . 

The  resulting  normalized  SNR  is  given  by  the  formula 

SNR  =  Vs  %  -l -  (1.10) 

(wNwHsN  s) 

This  ratio  is  always  between  zero  and  one 
0  <  SNR  <  1 

It  is  a  random  variable  because  the  estimated  weight  vector  w  is  a 

function  of  the  observed  data.  Reed,  Mallet , Brennan  [1]  have  derived 

the  distribution  of  the  SNR  for  the  above  weight  vector  estimate  based 
on  the  inversion  of  the  sample  covariance  matrix.  The  distribution 
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is  Beta  with  expected  value 


E(  SNR)  =  -L±_1__P_  (1.11) 

where  K  is  the  number  of  vectors  used  to  estimate  the  covariance  matrix 

and  p  is  the  matrix  order  . 

From  the  expected  value  of  SNR  formula  (1.11),  it  is  roughly  seen 
that  if  the  sample  size  K  is  small  with  respect  to  the  matrix  order, 
then  the  estimate  of  w  is  likely  to  be  poor  [3],  since  E(SNR)  is  small. 

(A3 )  Improved  Adaptive  Detection  for  Unknown,  but  Approx imately-Low- 

Rank  Covariance 

If  N  is  approximately  low  rank,  it  can  be  shown  theoretically 
through  eigenvalue  and  eigenvector  perturbation  analysis  (  Wilkinson 
[9]  )  and  experimentally  [10]  that  the  principal  eigenvalues  and 
eigenvectors  of  N  are  relatively  stable,  but  the  small,  near  zero 
eigenvalues  and  their  corresponding  eigenvectors  fluctuate  widely  with 
perturbation. 

These  results  suggest  that  it  should  be  possible  to  increase  the 
probability  of  obtaining  a  high  value  of  SNR  by  using  estimates  of  w 
based  on  the  principal  eigenvectors  of  N  .  Let  us  look  at  w  by 
decomposing  it  in  terms  of  the  eigenvectors  of  the  underlying  true 
covariance  matrix,  N  .  The  eigen  decomposition  of  N  is  N  =  V  A  where 
V  is  the  matrix  of  eigenvectors  and  A  is  the  diagonal  matrix  of 
eigenvalues.  The  k'th  eigenvector  of  N  is  denoted  by  v^  . 

Then  the  desired  weight  vector  of  (1.04)  can  be  written  as 
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_  -1  _  1  ,  T  .  .  1  ,  T  . 

w  =  N  s  =  — j—  (s  +  — jj—  (s  v 2>v2  + 


+  — r—  (s^v  )v  (1.12) 

Xp  p  p 


This  formula  shows  the  origins  of  the  difficulty  in  using  the  estimated 
weight  vector  of  (1*09).  The  right-hand-side  eigenvectors  and 
eigenvalues  of  (1.12)  would  then  be  replaced  by  the  corresponding 
estimated  values.  The  fluctuations  in  the  small  eigenvalues  can  then 
cause  large  errors,  because  their  reciprocals  are  used  in  the 
computation  of  the  weight  vector.  Next  assume  that  ^2  =  ^3  =  *  *  •'  = 

Xp  and  consider  the  case  in  which  X^  is  much  larger  than  the  other 
eigenvalues.  Let  us  consider  the  limiting  weight  vector  as 


1  f  T  T  T 

lim  w  =  -t —  I ( s  v  )v^  +  (s  v  )v-  +  .  .  .  +  (s  v  )v 

Xi_^fl0  K2  l  Z  Z  5  5 


p  pj 


(1.13) 


Neglecting  the  scale  factor  1/X£  which  does  not  affect  SNR,  we  can 
express  w  as 


lim  w 

x^® 


-  s  -  (s  v^)v^ 


(1.14) 


This  form  of  the  weight  vector  can  be  intrepreted  as  a  nul  1-steerer, 
because  it  eliminates  any  component  which  is  proportional  to  a  specific 
vector,  in  this  case  v^  «  Liu  and  Nolte  [5]  have  shown  that  when  the 
noise  covariance  matrix  N  is  near  rank  1  and  the  component  of  the 
signal  lying  in  the  direction  of  v^  is  not  strong,  then  the  performance 
of  the  weight  vector  of  (1.14)  is  about  the  same  as  the  optimum  weight 
vector  of  (1.04).  For  the  case  of  unknown,  but  approximately  low-rank 
covariance,  motivated  by  the  above  considerations,  we  propose  the  use 
of  the  following  weight  vector: 
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where  is  the  principal  eigenvector  of  N.  In  previous  work  we 

proposed  this  weight  vector  for  adaptive  detection  and  evaluated  its 
performance  through  simulation  [15]  .  Here  we  study  the  performance 

analytically  in  order  to  explain  the  results  of  the  simulation. 

Since  this  estimate  is  based  on  the  principal  eigenvector  of  N, 
and  the  principal  eigenvectors  are  relatively  unaffected  by 
perturbation  [10],  it  should  be  superior  to  the  conventional 
estimator  based  on  the  inversion  of  the  sample  covariance  matrix. 

Using  the  null  steerer  form  of  the  weight  Vector  formula  (1.15) 
and  an  approximation  for  the  principal  eigenvector  (of  the  estimated 
covariance  matrix  N)  obtained  through  one  iteration  of  the  power 
method,  we  will  derive  an  approximate  expression  for  the  distribution 
of  SNR,  formula  (1.10)  under  the  conditions  of  near  rank-1  noise  and 
large  sample  size.  Below  is  a  brief  outline  of  the  steps  we  will  take; 


(1)  Transform  SNR  formula  (1.10)  into  new  coordinates 
eigenvectors  of  N,  that  is 

P  P 


SNR 


i  i  dj  °j  ct 

j=l  k=l 


} 


1 


X 

n 


based 


on  the 


(1.16) 


with  c^ 


vk  s 


d 


k 


(s^Vj)vj 


(1.17) 

(1.18) 


and  where 


Xm  and  v^  are  the  eigenvalues  and  eigenvectors  of  N, 


respectively. 


(2)  Obtain  an  approximation  for  the  principal  eigenvector  of  N,  v^  , 
by  taking  one  iteration  of  the  power  method  [11]  using  v^  as  the 
starting  vector. 

▼i  ~  ?i  =  Nv^  (1.19) 

where  v^  denotes  our  approximation  to  v^. 

(3)  Expand  v^  using  the  eigenvectors  of  N  as  a  basis. 

I  =  \Tv1  (1.20) 

and 

vx  =  Vx  (1.21) 

Asymptotically,  the  expansion  scale  factors  in  vector  x  are  gaussian  as 
the  covariance  sample  size  tends  toward  infinity. 

(4)  Using  the  expansion  (1.21)  of  v^  in  place  of  v^  in  formula  (1,18), 
substituting  (1.18)  in  (1.16)  and  approximating  the  distribution  of  x 
by  a  gaussian  distribution,  then  as  the  noise  tends  toward  rank  1,  SNR 
formula  (1.16)  reduces  to  a  ratio  of  quadratics  that  are  a  function  of 
one  random  variable. 

a  +  a  0  +  a.  02 

SNR  =  — - = - - — — -  (1.23) 

a4  +  a5  p  +  a6  p 

where  the  a^,  k=l,2..6  are  constants  and  f  is  a  ratio  of  two 

asymptot icaly  gaussian  and  uncorrelated  random  variables. 

(5)  Finally  using  formula  (1.23),  the  distribution  of  £  (  the 

distribution  of  ratios  of  gaussians  [6]  is  available  in  closed  form  )  , 
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and  standard  univariate  random  variable  transformation  theorems,  the 
approximate  distribution  of  SNR  can  be  readily  obtained.  The  paper  will 
be  presented  in  three  main  parts;  (1)  Reduction  of  SNR  assuming  near 
rank-1  noise  and  large  sample  size,  (2)  Finding  the  approximate 
probability  density  of  SNR  using  the  reduced  form,  and  finally,  (3) 
experimental  results  . 
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CHAPTER  TWO 


I)  Reduction  of  SNR  asstuning  near  rank  1  noise  and  large  sample  size. 


Coord mate  Transformation  of  SNR 

We  start  the  derivation  by  re-expressing  the  signal  and  weight 
vectors  in  terns  of  the  eigenvectors  of  the  N,  recalling  that  the 
eigenvectors  of  N  form  a  basis.  This  coordinate  transformation  makes 
the  problem  more  tractable  analytically.  Performing  the  coordinate 
transformation  we  obtain 


P 

■  i  °k  ’t 


k=l 


P 


k=l 


(2.00) 


(2.01) 


where  the  Vj,'s  are  the  eigenvectors  of  N.  Now  substitute  formulas 
(2.00)  and  (2.01)  and  the  eigen-decomposition  of  N  into  SNR,  formula 
(1.10). 


SNR  = 


I  5 


j=l  k=l 


d  . 
J 


c  . 
J 


c 


k 


i 

m=l 


5 


X 

n 


(2.02) 


where  X.  are  the  eigenvalues  of  N.  The  d-  's  are  random  variables  that 

J  J 

are  a  function  of  w.  So  far  no  approximations  have  been  used.  We  simply 
have  a  different  expression  for  SNR. 

The  quadratic  forms  in  formula  (2.02)  that  involve  the  random 
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scale  factors  d-  can  be  thought  of  as  linear  combinations  of  the 

J 

products  djdj^.  With  this  in  mind,  we  will  proceed  by  first  determining 
the  approximate  form  or  distribution  of  the  products  djd^  under  the 
asymptotic  conditions  as  0  and  K->  00  (near  rank-1  covariance  and 

large  sample  size)  .  If  we  refer  back  to  formula  (1.18),  it  can  be  seen 
that  the  sole  contribution  to  the  random  component  of  random  variable 
dj  is  from  v*^,  the  principal  eigenvector  of  the  estimated  sample 
covariance  matrix.  Therefore,  the  next  step  is  to  determine  the 

approximate  distribution  (  as  and  K  ->»)  of  v^.  From  this  point 

onward  we  assume  that  the  noise  is  gaussian  and  strongly  rank  one, 
that  is,  the  noise  covariance  matrix  is  approximatly  rank  1.  To 
simplify  the  analysis,  the  principal  eigenvalue  of  N,  X^  is  fixed  at  1 
without  loss  in  generality.  Also,  assume  that  the  remaining 

eigenvalues  are  much  smaller  than  1  and  equal. 

X1  =  1  >  >  X2  =  X3  =  .  .  .  =  Xp  (2.03) 

The  form  of  the  weight  vector  that  we  will  be  using  is  the  null 
steerer  (1.15)  . 

w  =  s  -  (sTv1)v1  (2.04) 

Approximating  the  Principal  Eigenvector  of  N 

To  estimate  v^  #  the  principal  eigenvector  of  N  ,  we  use  a  three- 
step  procedure.  First  take  one  iteration  of  the  power  method  [11]  using 
v^  (recalling  that  v^  is  the  principal  eigenvector  of  N)  as  the 
starting  vector.  We  then  represent  the  resulting  vector,  Nv^  ,  in 
terms  of  the  principal  eigenvectors  of  the  true  covariance  matrix  N  as 
follows 
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(2.05) 


N  =  V  x 

in  which  the  columns  of  V  are  the  corresponding  eigenvectors  of  N. 

Finally,  we  form  our  estimate  of  ,  which  we  denote  by  v^,  by 

normalizing  the  above  vector  to  unit  length 

vx  =  [  1  /  (xTx)l/*  ]  V  X  (2.06) 

where  x  is  a  pxl  vector  with  elements  {x^}  containing  the  expansion 
scale  factors. 

We  have  shown  in  a  previous  paper  [10]  that  if  the  true 

covariance  matrix  of  the  noise,  N  ,  is  approximatly  rank  1  ,  then  even 

for  small  sample  sizes  of  16  or  32  observations,  v^  lies  in  nearly  the 
same  direction  as  v^  (  see  Fig.  1).  The  rate  of  convergence  of  the 
power  method  [11]  is  proportional  to  the  magnitude  of  the  ratio  of  the 
principal  eigenvalue  to  the  second  eigenvalue  and  since  the  starting 
vector  is  the  principal  eigenvector,  v-j  ,  of  the  underlying  population 
covariance,  it  follows  that  in  the  near  rank  1  case  convergence  should 
be  rapid  ,  implying  that  v^  should  be  an  accurate  estimate  of  v^  . 

In  appendix  A  we  show  that  the  scale  factors  (elements  of  x)  are 

asymptotically  multivariate  gaussian  and  independent  as  follows: 

x1  ~  N(  1  ,  2/K  )  (2.07) 

xk  ~  N(  0  ,  X2/K  )  for  k-2, 3 . . . p  (2.08) 


Determining  the  Weight  Vector  Expansion  Coefficents  d^ 

Let  us  now  find  the  expansion  coefficients  d^  of  formula  (2.01)  . 
To  obtain  the  d^  coefficents,  pre-mult iply  (1.15)  by  the  k'th 
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eigenvector  of  N. 

dk  =  vkTw  =  vkTs  -  (  sTvx  )(  vkTvx  )  (2,09) 
Note  that  ck=vk*s  .  Then  substitute  (2.06)  in  place  of  in  the 
weight  vector  expression  (2.09)  and  expand 


dt  =  ck 


5  c.  X. 

L.  J  J 

j=l 


I 


j=l 


1/2 


1 

j=l 


1/2 


(2.10) 


1  k 


e 


where 


y 


(2.11) 


(2.12) 


e 


(2.13) 


Before  we  form  the  products  d^d^  ,  it  is  noted  that  the  normalization 
terms  in  d^  (2.11)  are  simplified  to  a  function  of  as  — >  0 
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since  the  variance  of  the  Xj 's  (for  j^2,3..«p)  are  proportional  to  k2* 
This  corresponds  to  the  near  rank  1  case  « 


The  right-hand  side  of  (2  14)  is  a  good  approximation  of  the 
normalization  term  for  sufficently  small  *  Replace  the  normalization 
terms  in  formula  (2011)  by  the  approximation  (2.14)  . 


°1  Xk 


xk  y 


(2.15) 


Reduction  of  the  Products  djd^,  Under  Near  Rank— 1  and  Large  Sample 

Condition 

Using  the  formula  (2.15)  and  assuming  that  the  error  due  to  the 
simplification  of  the  normalization  term  (2.14)  is  neglible,  we  next 
compute  djd^. 
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(2.16) 


d. 

J 


c.c,  - 
J  * 


c.,c  .x. 
1  J  fc 


Wj 


C.IJ 

J-.fr:- 


2  2 
c„x.y  C-X.x,  2c„x.x<1y  x .  x,  y 

-  k  j  +  i  j  k  +  i  j  +  _L_kl_ 

2  2  3  4 

X1  X1  X1  X1 

We  now  determine  the  behavior  of  the  products  d-dv  (2.16)  in  the  near 
rank-1  an^  large  sample  case  (K->«>).  This  can  be  done  through 

calculation  of  the  expected  values  and  variances  of  the  individual 
random  terms  in  (2.16).  From  these  calculations  (see  Appendix  B)  it  can 
be  seen  that  the  variance  and  expected  value  of  the  i'th  random  term  ( 
for  j,ki£l,l  )  in  (2.16)  is  roughly  proportional  to  the  ratio  (X^/IO2*1 
where  is  some  integer  number.  This  implies  that  as  X»2“^  0  and  K-> 
the  term(s)  (  in  formula  (2.16)  )  having  a  variance  proportional  to  the 
least  power  of  X^/K  will  contribute  the  dominating  variance  to  djd^ 

(2.16).  It  follows  that  under  these  conditions,  the  random  component 
of  djd^  should  be  accurately  approximated  by  the  dominating  random  term 
in  (2.16)  in  respect  to  variance. 

The  approximate  expressions  for  the  products  d-dv  are  obtained 

J  & 

using  the  above  methodology  (with  the  exception  of  d^  ,  which  can  be 
simplified  algebraicly) .  We  have 
For  j  =1  ,  k=l 


(2.17) 


for  j=l,  k/1 
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(2.18) 


dl  dk  *  Dlk 


°k  y 


Finally  ,  for  j=2,3...p 
k=2p  3. . .p 


d .  cL  ~  D  =  c .  c, 

J  k  jk  j  k 


[c.  X  +  C  X.  I 

 1  k  k  J  ' 


(2.19) 


where  the  approximating  form  of  djd^  is  denoted  as  Dj^.  It  is  assumed 
that  c^O  in  the  above  formulas.  For  sufficently  small  ^2  and 
reasonable  values  of  K,  the  D^'s  should  be  good  approximations  to  the 
djd^'s  .  We  note  that  formulas  (2.17)  ,  (2.18)  and  (2.19)  are 
functions  of  random  variables  which  are  ratios  of  gaussian  random 
variables . 


Simplification  of  SNR  with 

Substituting  (  formulas  (2.17)  (2.18)  (2.19)  )  in  place  of 

djd^  in  formula  (2.02)  and  through  algebraic  manipulation  of  the 
numerator  and  denominator  terms,  we  can  transform  SNR  (2.02)  to  the 
desired  form,  formula  (1.23) 


where 


y 


x 


1 


(2.20) 


Start  by  simplifying  the  numerator  of  SNR.  From  (2.02)  the  numerator 
(  denoting  the  numerator  as  n)  is 
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p  p 

n  -  J  J  djdkCjCk  (2*21) 

j=l  k=l 

o 

Separate  the  numerator  double  summation  in  terms  of  d^  ,  d ^  (for 
k=2,3...p)  and  djd^  (for  j,k=2,3,..p)  . 


n 


=  C2  d2  +  2c,  5  c.  d,d.  +  5  5  d  d  c  c 

11  1  Z.  k  1  k  L  L  n  m  n  m 


(2.22) 


k=2 


n-2  m-2 


Through  (1)  substitution  of  Djj,  (  formulas  (2.17)  (2.18)  (2.19)  )  in 

place  of  djd^  in  formula  (2.22),  (2)  interchanging  the  order  of 
summation  in  the  last  term  of  n  (2.22)  and  factoring,  and  finally  (3) 
the  collection  of  equivalent  terms  ,  the  numerator  (2.22)  can  be 
written  as 

(2.23) 


’  p  p 

'  P 

V  \  2  2 

2  2 

/  )  c  c 

+  c,  y  -4c, 

)  ct 

L  L  n  m 

1  1  1 

L  k 

11 

to 

B 

II 

to 

2 

*=2 

1  1 

The  numerator  is  now  in  the  desired  form.  We  simplify  the  denominator 
in  a  similar  manner.  From  (2.02)  the  denominator  (denoting  the 
denominator  as  d)  is 


d  = 


i 

Lj=i 


C  . 

J 


1  >-A 


k=l 


(2.24) 


As  stated  previously  ,  we  assume  that 


h.  =  1 


and 


lo  • • • ,  1 
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2 

Now  separate  the  denominator  summation  in  terms  of  d^ 
j=2,3...p)  and  the  and  I/X2  scale  factors. 


and  dj2 


for 


d  =  c^dj  + 


j=2  k=2 


2.2 

Ckdj 


_1 


5 

k=2 


2,2 

Ckdl 


+  X 


\  2,2 
2  2  Cldj 
j=2 


(2.25) 


Then  as  before,  through  (1)  substitution  of  (  formulas  (2.17) 
(2.18)  (2.19)  )  in  place  of  djd^.  in  (2.25),  (2)  interchanging  the  order 
of  summation  in  the  second  and  fourth  terms  of  (2.25)  and  factoring, 
and  finally  (3)  the  collection  of  equivalent  terms,  the  denominator  can 
be  written  as 


’  p 

\  2„  2 

2 

'  P  P 

\  \  2  2 

,  2 

P 

V  2 

2  CkA2  +  C1 

y  + 

2  2  Vj 

+  X2C1 

2  ck 

*=2 

2 

j=2  k=2 

.  k=2 

xi 


2  c. 


3 

lk=2 


♦  V? 


(2.26) 


Using  the  simplified  forms  of  the  numerator  (2.23)  and  denominator 
(2.26)  and  forming  their  ratio  ,  the  approximate  SNR  is 
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SNR  s 


a  +  ajP  +  a20 

2 

a  +  A  +  P  +  a^0 


where  =  -  4 


1  4 

Lk=2 


a2  =  C1 


P  P 


-I  144 

j=l  k=l 


A  =  X2cx 


Lk=2 


a3  =  "  2  C1 


Lk=2 


+  X2C1 


a4  = 


p 

■ 

1  4' h 

+  C2 

+  °1 

m  k=2 

(2.27) 

(2.28) 

(2.29) 

(2.30) 

(2.31) 

(2.32) 

(2.33) 


The  SNR  is  now  a  function  of  one  random  variable,  0  .  We  have  obtained 
the  form  of  SNR  that  we  wanted.  The  density  of  SNR  can  now  be  readily 
be  obtained  using  standard  univariate  transformation  theorems  for 
functions  of  random  variables. 


Validity  of  Approximations 

Although  earlier  we  stated  that  the  reduced  formulas  for  Dt 

J  * 

(2.17),  (2.18),  and  (2.19)  only  hold  for  Cj^O  for  j=l,2...p  and 
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for  k=l,2..„p  ,  our  above  result  (2.27)  is  valid  even  when  some  of  the 
Cj's  and  c^'s  are  zero  or  very  small.  This  is  because  the  D^'s 
associatted  with  the  relatively  large  non-zero  Cj 's  and  c^'s  contribute 
the  dominating  variance  in  formulas  (2.23)  and  (2.26)  .  By  comparison, 
the  D^'s  associated  with  the  zero  or  very  small  cj's  and  c^'s 
contribute  generally  little  vaiiance  to  (2.23)  and  (2.26)  under  the 
near  rank-1  and  large  sample  size  condition. 

The  accuracy  of  the  approximation  for  SNR  (2.27)  can  be  determined 
through  the  error  calculations  in  Appendix  B. 
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CHAPTER  THREE 


II)  Determining  the  approximate  probability  density  of  SNR  using  the 

reduced  form. 

In  section  I  it  was  shown  that  when  the  noise  covariance  matrix 
is  almost  rank  1  and  the  sample  size  is  sufficently  large  ,  the  SNR 
reduces  to  a  function  of  a  single  random  variable  p  that  is 
approximatly  a  ratio  of  gaussians.  Obtaining  the  density  of  SNR  is  now 
a  simple  two  step  procedure: 

1)  Determine  the  density  of  p  . 

2)  Using  standard  univariate  transformation  theorems,  obtain  the 
density  of  SNR  with  from  density  of  p  . 


Determining  the  Density  of  P 

Recall  from  section  I  that  p  (2.20)  is 


P  = 


}  Vi 
U=* 


(3.00) 


In  appendix  A  it  was  shown  that  the  x^'s  for  reasonable  sample  size  K 
tend  toward  ganssian,  therefore  the  random  variable  ft  can  be 
approximated  as  a  ratio  of  independent  ganssian  random  variables.  From 
appendix  A  the  normal  approximations  were  shown  to  be: 

xx  _  N(l,  2/K)  (3.01) 

xk  „  N(0,  12/k)  for  k=2, 3, . . .p  (3.02) 

We  can  therefore  consider  p  as  a  ratio  of  two  ganssian  random  variables 
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x  and  a  as  follows: 


0  =  x/u  (3.03) 

where 

(3.04)  (3.05) 


j=2 


The  means  and  variances  of  x  and  n  are 

E[x]  =5=0,  E[u]  =5=1  (3.06) 


P 


Lj=2 


2  =  2/K 
u 


(3.07) 


Kanter  [6]  lias  derived  a  general  form  of  the  probability  density  for 
the  ratio  of  two  gaussian  random  variables  ,  using  the  same  notation 
as  before  we  have 


p(0)  =  [^Y  j  exp  [-*<*  +  l)j  /  ( s?0)  +  1) 

(3.08) 

*  |z(p)  erf(  z(p)  )  exp(  zip)  )  +  j 

where  a  =  a  ,  b  =  a 

(3.09) 

x  u 

r  =  correlation  coefficient  0  <  r  <  1 

(3.10) 

y  =  ab  Vd-r^) 

(3.11) 

2  2 

0  =  u/  2b 

(3.12) 

s(p)  =  (b2p  -  rab)/y 

(3.13) 

s  =  (b2(x/u)  -  rab)/y 

(3.14) 

z(p)  =  V#  (  s  s(p)  +  !)/>/(  sip)  +  1  ) 

(3.15) 
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Noting  that  the  correlation  coefficent  is  zero  (  r=0  )  since  x^ 
and  for  k=2,3...p  are  approximatly  independent,  we  can  now  obtain 
the  density  of  P  directly  through  substitution. 


p(0)  =  [Jl  Mx2D]  [exp  -K/4]  /  [(2/X2D  02  +  1]  (3.16) 


JK.  /  2 

erf 

'  A  /  2 

'  K/4 

1 

-L 

V[(2/X  p20  +1  ]. 

y[(2/x2A+i]. 

e  xp 

.  (2/P)  p2  +  1  . 

where  V  = 


P 

\  2 
=  >  c . 

^  J 
j=2 

We  have  obtained  the  density  for  0. 


(3.17) 


At  this  point  we  can  derive  the 


approximate  density  of  SNR. 


Finding  the  Approximate  Density  of  SNR 

To  calculate  the  approximate  density  of  SNR,  we  need  the  use  of 
the  following  random  variable  transformation  theorem  [8] 

Theorem  A:  Given  a  function  g(p),  where  p  is  a  random  variable  with 
density  p(P)  ,  the  density  of  g(p)  can  be  found  using  p(p)  as 
follows:  we  solve  the  equation  y=g(p)  and  denote  its  real  roots  by 

P1#  P2 - Pn.  Clearly,  the  values  of  the  roots  depend  on  y.  Then  the 

density  of  y  is  given  by  the  formula 


P(  Pi  ) 

_  4-  4- 

p(  pn ) 

|  ^  P1  ] 

•  <  K  > 

(3.18) 
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where  g(  p  ) 


d  g(p) 


(3.19) 


dp 

and 

2 

a  +  s  p  +  a.p 

g(P>  =  - - = - - - *-  (3.20) 

a  +  A  +  s3P  +  *+p 

Since  g(p)  is  a  ratio  of  quadratics,  it  follows  that  there  are  two  real 
roots.  Multiplying  both  sides  of  formula  (3.20)  by  the  denominator  of 
g(p)  and  collecting  terms  we  have 

ya  +  yA  +  ya3P  +  ya^p2  =  a  +  a^P  +  a2P2  (3.21) 


(ya^  -  a^jp2  +  (ya^  -  a^p  +  (a[y-l]  +  yA)  =  0  (3.22) 

Note  that  formula  (3.22)  is  in  the  form  of  a  standard  quadratic, 
therefore  the  standard  root  formula  for  quadratic  equations  can  now  be 
applied  to  obtain  the  roots  of  g(p)  .  The  two  roots  are 

(a^  -  ya^ )  +  [  (ya^-a^)2  -  4(ya^  -  a2)  (a[y-l]  +  yA  )  j  1/^2 
P1.2  =  2(ya4  -  a2)  ” 

(3.23) 

Next  we  determine  the  derivative  of  g(p)  with  respect  to  p. 
Differentiating  we  get 


dg  (p) 


dp 


=  (a.  +  2a. p)  (o  +  A  +  a,P  +  a.p  ) 


2.-1 


(3.24) 


-(a  +  a.^P  +  a2p2)  (ag  +  2a^p)  (a  +  A  +  a^P  +  a^p2)  2 
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We  can  now  obtain  the  approximate  density  of  SNR  through  direct 
substitution  using  theorem  A  formula  (3.18),  the  density  of  0  (3.16), 
the  roots  *1.2  (3.23)  and  the  derivative  g'(0)  (3.24).  Denoting  the 

density  of  SNR  as  f(y)  ,  we  get 


p<  ) 

_  4-  _ 

P( 

*2  > 

1  ‘‘  "l  > 

1 

g( 

h  >  | 

(3.25) 


We  recall  that  0^  and  02  are  functions  of  y.  The  dependence  on  y  is 
given  in  formula  (3.23).  The  density  f(y)  exists  over  the  region  where 
0^  and  02  are  real  . 


Asymptotic  Moments  of  SNR  when 

The  formulas  we  have  derived  for  the  probability  density  of  SNR 

(3.25)  are  complicated  and  one  would  probably  have  to  resort  to 
numerical  evaluation  of  the  integrals  to  obtain  the  first  and  second 
moments  of  SNR.  However,  in  the  extreme  case  when  it  can  be 

shown  that  asymptotically  as  K 


SNR  1 


(  1  -  c\  ) 

K 


2 

z 


(3.26) 


where  z~N(0,l)  and  "d"  implies  convergence  in  distribution.  Using 

(3.26)  we  can  readily  obtain  the  expected  value  and  variance  of  SNR. 
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E[  SNR  ] 


(3.27) 


2  2 

k  -  (  i  -  c  j  r 

K 


Var [  SNR  ] 


2 


(3.28) 


Proof:  First,  it  was  shown  in  Appendix  A  that  the  numerator  and 
denominator  of  p  (3.00)  are  asymptotically  gaussian  (see  Appendix  A  for 
detail).  Through  application  of  a  theorem  for  the  asymptotic 

distribution  of  a  function  of  asymptotically  gaussian  random  vectors 
[Theorem  B,  pg.  124,14]  ,  it  is  seen  that  P  (3.00)  itself  is 

asymptotically  gaussian  as  K  ->®  as  follows: 


P 


1/2 

z 


(3.29) 


where  z~N(0,l/K)  .  Next,  without  loss  in  generality  set  the  signal 

power  to  unity,  that  is 


j=i 


(3.30) 


The  summation  in  (3.29)  can  now  be  rewritten  as  a  function  of 
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(3.31) 


e  ^  [  l2  (  1  -  4 


substitute  (3.31)  in  place  of  0  in  formula  (2.27)  and  let  0  (note 

that  is  constrained  to  be  c^il  in  formula  (3.31)  ). 

-  d  1 

SNR  ->  - - - = -  (3.32) 

1  +  (  1  -  Cj  )  z 

Finally  using  (3.32)  and  [  Theorem  B,  pg.  124,14]  (asymptotic 
distribution  of  functions  with  vanishing  first  order  derivatives)  we 
get  the  asymptotic  distribution  of  SNR  as  K  . 

These  formulas  should  generally  give  a  good  estimate  of  the 
moments  of  SNR  even  for  the  general  case  when  ^2  is  close  to  zero  and 
K  is  large.  Using  the  formulas  for  the  expected  value  of  SNR  for  the 
low  rank  filter  weight  estimate  formula  (3.27)  and  formula  (1.11) 

when  the  filter  weights  are  based  on  the  inversion  of  the  sample 

covariance  matrix,  we  can  roughly  determine  the  number  of  samples 
needed  to  attain  equivalent  performance  (  in  respect  to  the  expected 
values  of  SNR  for  both  methods  )  using  the  conventional  filter  weight 

estimate  (1.09)  compared  against  the  improved  rank-1  filter  weight 

estimate  (1.15)  .  Denoting  the  number  of  samples  used  to  estimate  the 
noise  covariance  in  the  low  rank  method  as  Kj  and  the  sample  size  for 
the  conventional  detector  as  Kq,  to  attain  equivalent  performance  , 
must  be 

Kc  s  Kr  [  (  p  -  1  )/(  1  -  Cl2  )  ]  -  1  (3.33) 


25 


CHAPTER  FOUR 


III)  Experimental  Results 

Computer  simulation  results  for  the  distribution  of  SNR  are 
presented  for  three  cases;  (1)  rank-1  interference  plus  white  noise, 
(2)  a  highly  correlated  I'st  order  autoregressive  noise  component  plus 


white  noise,  and  (3)  when  the  interference  data  being  used  to  estimate 


the  interference  covariance  matrix  is  contaminated  by  signal.  Further, 
for  the  rank-1  interference  plus  white  noise  case,  we  show  the 
improvement  of  the  low  rank  filter  weight  estimates  over  the 
conventional  estimate  (based  on  the  inversion  of  the  estimated  sample 
covariance  matrix). 

The  notation  is  the  same  as  in  sections  I  and  II.  The  rank-1 
interference  plus  white  noise  gaussian  noise  vector  is  generated  as 
follows  : 


P 


n. 


k 


(4.00) 


j-1 


where  the  scale  factors  w^j  are  zero-mean  and  independent  gaussian 


random  variables  with  variance 


Var[  w ^  ]  =l  +  o^ 


(4.01) 


and  for  j=2,3. . ,p 

Var [  w 1  “  a2 


(4.02) 


The  vectors  r  j  (j=l#2...p)  are  the  normalized  eigenvectors  of  the 


matrix  R.  The  elements  of  R  are 


(4.03) 


26 


The  matrix  R  corresponds  to  the  covariance  of  a  first  order  AR  process 
with  correlation  a,  therefore  the  noise  vector  n^  corresponds  roughly 
to  a  snapshot  of  a  1'st  order  autoregressive  noise  component  plus  white 
noise  if  a >>Yj  (for  j=2,3...p)  where  the  Yj  are  the  eigenvalues  of  R. 
The  interference-to-noise  ratio  is  defined  as 

INR  =  101og10(  1  /  pa2  )  (4.02) 

where  p  is  the  covariance  matrix  order. 

The  signal  vector  we  shall  use  is 

sk  “  cos(  2n  f  (k-1)  )  for  k=l#2...p  (4.03) 

where  f  is  the  frequency. 

For  our  computer  simulation,  we  set  a=.9999,  p=20,  K=25 

(covariance  sample  size).  Three  hundred  independent  trails  were 
performed  with  INR  being  varied  from  lOdB  to  15dB  and  the  signal 
frequency  varied  from  .03  to  .06  .  The  noise  covariance  matrix  was 

estimated  using  the  max imum- 1 ikl i hood  estimate  formula  (1.08). 

Scattergrams  (see  Fig.  2)  show  that  the  SNR  approximation  is  accurate  . 
Next,  histograms  with  confidence  bounds  were  generated  using  the 

simulated  data.  The  confidence  bounds  were  calculated  by  noting  that 
the  frequency  count  in  a  particular  histogram  bin  follows  the  binomial 
distribution  and  then  using  the  DeMo irve-Laplace  theorem  [8]  to 

estimate  the  standard  deviation  of  the  frequency  count, 

crfc  =  V(  n  frk  (  1  -  frk  )  )  (4.04) 

where  n  is  the  number  of  trials  and  frk  is  the  expected  frequency  for 
the  k'th  histogram  bin  obtained  using  the  derived  SNR  density  (3.25)  . 
Figure  3  shows  that  the  experimental  data  fits  the  SNR  density  (3.25) 
well. 

Next  we  show  that  the  probability  density  formula  (3.25)  for  SNR 
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can  be  also  used  to  predict  the  performance  of  the  detector  when  the 
interference  is  a  mixture  of  highly  correlated  l'st  order  AR  process 
noise  and  white  noise.  The  noise  vector  n^  is  generated  using  (4.00) 
and  the  same  parameters  as  before  except 

Var [  wtj  ]  =  Yj  +  cr2  for  j=l,2...p  (4.05) 

where  y  j  (j=l,2...p),  are  the  eigenvalues  of  matrix  R,  and  the  value  of 
the  signal  frequency  f  is  .16  .  In  evaluating  the  SNR  density  formula 
(3.25)  ,  we  assume  that  ^2  is  proportional  to  ,  that  is, 

2 

a 

X2  =  ~~T  (4.06) 

rx+  ^ 

or  equivalently  that  y^O  for  k=2,3...p  .  Histograms  (  see  Fig.  4  ) 
show  that  we  get  relatively  good  agreement  with  the  predicted 
distribution  . 

When  the  noise  data  is  contaminated  by  the  signal  that  is  being 
received,  that  is, 
hk  =  n^  +  SqS 

where  sq  is  a  scalar,  we  can  still  attain  reasonable  performance  using 
the  rank-1  filter  weight  estimate  .  This  is  shown  through  experimental 
results.  The  signal-to-white-noise  ratio  (SWNR)  of  the  contaminating 
signal  is  defined  as 

SWNR  =  101og10(  s02  /  2 a2  )  (4.07) 

Using  the  same  methodology  and  parameters  as  in  the  first  set  of 
experiments  (a=.9999,  INR=10dB,  K-25)  and  with  signal  frequency 
f=.047,  we  generate  the  signal  contaminated  noise  data  using  (4.06)  and 
SWNR=-15dB  .  The  histogram  of  the  experimental  data  (see  Fig.  5)  and 
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statistics  indicate  even  with  signal  contamination,  we  can  still  attain 
relatively  high  values  of  SNR. 

By  evaluating  the  formula  for  the  expected  value  of  SNR  (1.11)  and 
the  density  formulas  derived  by  Reed,  Mallet,  Brennan  [1, formula  17] 
for  the  conventional  adaptive  detector  based  on  the  inverse  of  the 
sample  covariance  matrix  and  evaluating  the  density  of  our  improved 
detector  using  the  SNR  density  formula  (3.25)  ,  it  can  be  seen  that  for 
even  small  sample  sizes  (see  Fig.  6,7),  the  filter  weights  based  on  the 
principal  eigenvector  yield  superior  results  in  this  example. 

Below,  the  approximate  formulas  that  were  derived  in  Chapter  3  for 
the  expected  value  of  SNR  (3.27)  and  variance  (3.28)  are  evaluated  and 
compared  against  the  computer  simulation  results  obtained  earlier.  It 
can  be  seen  from  the  below  results,  that  formulas  (3.27)  and  (3.28)  are 
accurate . 


a)  mean  and  standard  deviation  of  SNR  calculated  using  the  approximate 
formulas  (3.27)  and  (3.28)  when  INR=10  dB,  a=.9999,  K=25 


f=.  03 

:  E[SNR]=. 962  ,  Dev [SNR]=. 0542 

(4.08) 

f=.  04 

:  E[SNR]=.  965  ,  Dev [SNR]  =  . 0500 

(4.09) 

f=.  05 

:  E[SNR]=. 960  ,  Dev[SNR]=. 0566 

(4.10) 

f=.  06 

:  E[SNR]=. 963  ,  Dev [SNR]=. 0524 

(4.11) 

b)  mean  and  standard  deviation  of  SNR  obtained 

through 

computer 

s imulat ion 

based  on  300  independent  trials  and 

us  ing 

the  same 

parame  ters 

as  before 

II 

o 

:  E [ SNR] =.965  ,  Dev [SNR] =.0442 

(4.12) 

f=.  04 

:  E[SNR] =. 965  ,  Dev [SNR] =. 0419 

(4.13) 
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f=. 05  :  E[SNR]=. 967 

,  Dev [SNR] =.0438 

(4.14) 

f=.06  :  E[SNR]=. 967 

,  Dev[SNR]=. 0398 

(4.15) 
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CHAPTER  FIVE 


Conclus ion 

The  formulas  we  have  derived  are  useful  over  a  reasonable  range 
of  interference-to-noise  ratios  and  signal  types.  For  near  rank-1 
noise,  the  null  steerer  generally  provides  good  performance  over 
conventional  detectors  based  on  sample  covariance  matrix  inversion. 
Further,  these  results  should  give  insight  into  determining  optimal 
adaptive  detectors  and  their  performance  for  higher  rank  near  singular 
noise . 

The  reader  may  question  why  we  did  not  use  the  known  asymptotic 
distribution  of  the  principal  eigenvector  of  a  Wishart  matrix  [13]  in 
deriving  the  SNR  probability  density.  Through  experimentation  ,  we  have 
determined  that  the  power  method  approximation  for  the  principal 
eigenvector  of  the  estimated  sample  covariance  matrix  is  much  more 
accurate  for  small  sample  sizes  than  the  extreme  asymptotic 
distr ibut ion. 


31 


APPENDIX  A 


Determining  the  Form  and  Pi stribution  of  x^. 

We  will  compute  the  expansion  scale  factors  which  are  defined  in 
formula  (2.05)  and  show  that  the  x^  are  asymptot icaly  gaussian.  Recall 
that  the  eigen-decomposition  of  N  is 

N  =  V  A  VT  (al.O) 

Neglecting  its  length  ,  the  principal  eigenvector  of  N  is  approximated 
by  Nv^  and  it  can  be  represented  using  the  matrix  V  of  column  vectors 

which  are  the  eigenvectors  of  the  true  covariance  matrix  N  as  follows: 

N  vx  =  V  x  (al. 1 ) 

in  which  x  is  the  pxl  column  vector  of  the  scale  factors. 

x  *  £  X1  x2  •  •  •  •  xp  ]T  (al. 2) 

Then 

x  =  VT  N  v1  (al. 3) 

Next,  v^  can  be  rewritten  as 

=  V  b  (al. 4) 

where  b=[100.,.0]  .  Note  that  the  dimensions  of  b  are  pxl 

.  Now  substitute  formula  (al.4)  into  (al.3) 

X  =  VT  N  V  b  (al. 5) 

To  obtain  the  distribution  of  x  we  need  to  first  find  the  distribution 
of  V  NV  .  Use  a  theorem  of  Wishart  matrices  (from  [7]),  recalling  that 
N  is  Wishart  [13]  .  For  additional  discussion  and  use  of  the  Wishart 

distribution  of  estimated  covariance  matrices  see  (Anderson  [7]), 
(Goodman  [16]),  (Reed,  Mallet,  Brennan  [1])  and  (Capon  and  Goodman 
[17]). 

Theorem  B:  If  N  ~  Wp(  N.K  )  ,  then  VT  N  V  ~  Wp(  V1  N  V  ,  K)  . 

In  this  notation,  Y~Wp(X,K)  means  that  the  pxp  matrix  Y  is  Wishart 
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distributed  with  expected  value  X  and  K  degrees  of  freedom. 

There  fore 

VT  N  V  ~  Wp(  VT  N  V  ,  K)  (al.6) 

The  distribution  parameters  of  (al.6)  can  be  simplified  by  substituting 
the  eigen-decomposition  of  N  in  place  of  N. 

Then 

VT  N  V  ~  Wp(  A  .  K  )  (al. 7) 

where  A  is  the  diagonal  matrix  of  eigenvalues  of  N.  We  now  have  the 
distribution  of  V*NV  .  Anderson  [7]  has  shown  that  the  sample 
covariance  matrix  is  asymptotically  gaussian  distributed  as  the  sample 
size  increases.  The  equivalent  can  be  stated  for  Wishart  matrices  as  K 
.  The  theorem  from  Anderson  [7]  is  re-stated  below  for  the  case  of 
Wishart  matrices. 

Theorem  C:  If  1  is  Wishart  W^(  ]>  ,  K  )  ,  then  the  asymptotic 

distribution  of 


(al. 8) 


is  normal  with  mean  0  and  covariances 

E[  xij  xki  ]  =  °ik  aji  +  °ii  «jk  (al-9> 

where  x^.  is  the  i,j'th  element  of  matrix  X  (al.8)  and  cr- •  is  the 
J  i  j 

i,j'th  covariance  from  I  . 

Let 

1  =  VT  N  V  U2.0) 

then 

*  =  1  b  (a2. 1) 
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It  can  now  be  seen  that  x  is  simply  the  first  column  of  >.  By 
application  of  theorem  C  directly  to  formula  (al.5)  and  using  formula 
(al.9),  it  can  be  easily  shown  that  x  is  asymtotical ly  multivariate 
gauss ian  with  mean 

E[  xT  ]  =  IT  =  [1  0  0  ...  0  ]T  <a2.2) 

and  covariance  matrix 


(a2. 3 ) 


E[  (x-I)(x-i)T] 


2/K  0  0 

0  X  /  K  0 

0  X  /K  0 


0 

0 


0 

0 


0 

0  x2/k  0 
o  x2/k 


of  dimension  pxp  and  where  K  is  the  number  of  vectors  used  in 
estimating  the  covariance  matrix  N.  Note  that  the  elements  of  x  are 
asymptoticaly  uncorrelated,  therefore  independent.  Further  ,  for 
reasonable  sample  size  we  can  consider  the  distribution  of  x  to  be 
approximatly  multivariate  gaussian  with  the  above  parameters. 


APPENDIX  B 

Means  and  Variances  of  and  the  Approximation  Errors 

In  appendix  B  we  will  first  compute  the  error  of  approximating  the 
products  djClfc  (  formula  (2.16)  )  by  the  corresponding  asymptotic 

results  (  formulas  (2.17)  (2.18)  (2.19)  )  and  then  the  respective 

means  and  variances  of  and  the  approximation  errors  for  the  near 

rank  1  covariance  matrix  and  large  sample  case.  The  approximation  error 
Ajk  is  given  by 
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d.  d, 
J  k 


(bl.O) 


D 


jk 


Through  substitution  of  formulas  (2.16),  (2.17),  (2.18),  and  (2.19) 

into  formula  (bl.O)  we  get  (it  is  noted  that  A^=0  ): 

For  j=l  ,k=2,3...p  the  error  is 


-°i  *k  y 


lk 


Xk  y 


(bl.l) 


and  finally  for  j=2,3,...p 
k=2,3, . .  .p 


Ajk 


c  .x,  y 
J  fc 


2  c 


c.  x .  y 
k  J 


i  x*  y 

1  J  k 


2 

C1  x*  X, 

1  J  k 


(bl.3) 


We  will  now  calculate  the  mean  and  variance  of  the  approximations  D.t 

j  jc 

(formulas  (2.17)  (2.18)  (2.19)  )  and  the  approximation  error  terms 
(formulas  (bl.l)  (bl.2)  (bl.3)  )  .  Since  D-^'s  an^  Ait 's  are  sums  of 
ratios  of  uncorrelated  random  variables,  we  need  the  use  of  the 
following  formulas  for  eatimating  the  mean  and  variance  of  ratios  of 
two  random  variables.  Given  uncorrelated  random  variables  u  and  x,  then 
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(bl.4) 


E[  "a”  ]  °  ECT  *“d  V“[^-] 


(bl.  5) 


These  approximations  (bl.4)  and  (bl.5)  are  generaly  accurate  when 


(bl. 6) 

E[  u  ]  *  0  ,  F[  u  ]  >>  a 


(bl.  7) 


and 


<< 


(bl. 8) 


E[  u  ]  E[  x  ] 

2  2 

where  <xx  and  <*u  are  the  variances  of  x  and  u  respectively.  Note  that 
although  the  moments  of  these  ratios  might  not  exist  in  the  strict 
theoritical  sense,  these  estimates  (formulas  (bl.4)  and  (  bl.5)  ) 

should  give  an  good  indication  where  the  bulk  of  the  probability 
density  mass  of  the  ratio  x/u  lies  (using  the  Tchebycheff  inequality 
[8]).  Further,  note  that  the  above  conditions  (bl.6),  (bl.7),  and 
(bl.8)  are  essentially  satisfied  in  the  case  that  we  are  considering, 
near  rank  1  covariance  and  large  sample  size  .  Using  formulas  (bl.4) 
and  (bl.5)  and  the  gaussian  approximations  for  the  x^'s  as  derived  in 
appendix  A  we  get 

Note  that  throughout  the  mean  and  variance  results  we  shall  use 


'-5 

n=2 


(bl.  9) 


We  now  calculate  the  expected  value  and  variance  of  the  approximations 
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^jk  ^  formulas  (2.17),  (2.18)  and  (2.19)  )  and  the  error  terms 

(formulas  (bl.l)  and  (bl.3)  )  using  formulas  (bl.4)  and  (bl.5)  . 


1)  D 


11 


(b2. 0) 


E[  DU1 


x2  r 


2  X 


2  r2 


K  [  1  +  2/K  ] 


(b2. 1) 

Vart  p  ]  * - - - - - 

t  [  1  +  2/K  I 


2)  D 


lk 


k=2,3. .  .p 


hi  »lti 


s  0 


X2  C 


2  \  2 
k  Z  Cn 


Var[  Dlfc] 


n=2 


K 


Djj  :  j-2, 3. . . p 


E[  D . . ]  = 

JJ 


Vart  D . . ] 
JJ 


2 
o . 
J 


2  2 
4  X,  c,  c^T 

1—1  1 

K 


4)  Djk  :  j^k  for  j=2.3...p 

k=2, 3. . . p 


(b2. 2) 

(b2. 3) 

(b2. 4) 

(b2.  5) 
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(b2. 6) 


E[  D  ]  s  c.  c. 
jk  j  k 


Var [  D .,  ]  s 
Jk 


^2  C1  [  *]  +  Ck  1 

K 


The  mean  and  variance  of  the  error  Aj^.  is 


1)  A^  :  k  2, 3. . . p 


E[Aik]  - 


X2  C1  Ck 

K  [  1  +  2/K  ] 


The  variance  of  the  terms  of  Aj^  are 


Var 


C1  xk  7 


,22,2 

X2  C1  (  ck  +  17  } 

K2  [  1  +  2/K  ]2 


Var 


Xk  7 


x3  (  12  c2  r  +  3  r2 

K3  [  1  +  6/K  ]2 


2)  Ajj  :  j  2.3...P 


X,  c2  -  2  X  c2  X,  (  2  c2  +  T  ) 

Et  AJ j  ]  s  !  r:  .  7Z  -  +  -3 — - - 


K  [  1  +  2/K  ] 


K  +  12  K  [  1  +  1/K  ] 


The  variance  of  the  terms  Ajj  are 


(b2. 7) 


(b2.  8) 


(b2.  9) 


(b3 . 0) 


(b3 . 1 ) 
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Var 


2  2 
hlL 


„  ,2  4 

2  X2  C1 


K2 


[  1  +  2/K  ]' 


(b3. 2) 


Va* 


2  c  .  x .  y 
J  J 


4  x2  c2  (  c2  +  r  ) 
2  j  j 

K2  [  1  +  2/K  ] 


(b3.3) 


Var 


2  l 


\l  (  12  C2  +  3  r  ) 

L _ J _ _ 

K3  [  1  +  6/K  ]2 


(b3. 4) 


Var 


2  2, 

*k  y 


X*  £  (24c?  +  D  (72c2  +  9D  -  (2c?  +  T)2 


J. 


4b3.5) 


K 


1  +  (12/K)  (  1  +  1/K  ) 


3)  Ajk  :  j#c  for  j=2,3...p 


k=2, 3.  . .  p 


E[  A..]  = 

jk 


~2  X2  °i  Ct 

K  [  1  +  2/K  ] 


2  X,  c .  c. 
2  J  k 


K  +  12  K  [  1  +  1/K  ] 


(b3. 6) 


The  variance  of  the  terms  of  A 


jk 


are 


Var 


C1  X 


i2  4 
X2  °1 


K2  [  1  +  2/K  ]2 


(b3. 7) 
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Var 


(b3.8) 


Var 


Var 


Var 


•i  '  1 

. 

c2  (  <:?  +  T  ) 

"  J  ^ 

x?  J 

9  2 

a  [  1  +  2/K  ]Z 

ck  xj  y  1 

k-  c  ?  c.  J  r  ) 

~  L  *  J 

2 

X1  J 

K2  [  1  +  2/K  ]2 

f  2  Xj  Xk  7 

_  4  Xj  [2uS^l.r] 

3 

X1 

« 

K3  [  1  +  6/K  ] 

2 

Xi  %  7 

J  .  l2  [  \  'j  +  <  °j  +  >  1  +  ^  ] 

4 

X1 

J  K4  f  1  +  (12/K)  [  1  +  1/K  ]  | 

(3.9) 


(b4. 0) 


(b4. 1) 
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a)  Eigenvector  // 1  :  10=16 

mean=9.8,  standard  deviat ion=5 . 59  (degrees) 
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b)  Eigenvector  //l  :  K=32 

PI  mean=6.57,  standard  devation=3.1  ('degrees'1 

Histograms  based  on  500  independent  trials  of  the 
magnitude  of  the  angular  perturbation  of  the  principle 
eigenvector  of  FT  .  N  (1.08)  was  generated  with  K 
i independent  realizations  from  a  first-order  autoregressive 
' process . 

n(j)  =  .9n(j-l)  +  w(j)  for  j=l,2...10 

k  k  k 

where  w(j)^  are  independent,  zero-mean  ;  unit  variance  gauss  inn 
random  variables. 

The  magnitude  of  £he  angle^  between  the  principle 
eigenvector  of  E(  N  )  and  N  is 
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Fig.  2)  SCATTERGRAMS  OF  TRUE  SNR  FORMULA  (1.10)  VS. 

APPROXIMATE  SNR  FORMULA  (1.23)  BASED  ON  500 
INDEPENDENT  TRIALS.  THE  EXPERIMENTAL  PARAMETERS 
ARE: 

a=  .9999  ,  p=20  (  COVARIANCE  MATRIX  ORDER) 

K=25  (  COVARIANCE  SAMPLE  SIZE  ) 


AmOMMAT:  SMt 


O 
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I N'R=  1 5  dB  ,  SIGNAL  FROQUI-NCY:  f=.()3 


Fig.  3)  HISTOGRAMS  OF  SNR  FORMULA  (1.10)  BASED  ON  300 
INDEPENDENT  TRIALS  .  BOUNDS  ARE  PLACED  ON  THE  EXPERIMENTA LY 
OBTAINED  BIN  FREQUENCIES  ,  ASSUMING  THAT  SNR  HAS  THE 
DERIVED  PROBABILITY  DENSITY  (3.25)  AND  THEN  CALCULATING 
THE  EXPECTED  VALUE  AND  ESTIMATED  STANDARD  DEVIATION  OF  THE 
BIN  FREQUENCY.  HISTOGRAMS  ARE  GENERATED  USING  50  EQUALLY 
SPACED  BINS.  THE  EXPERIMENTAL  PARAMETERS  ARE: 
a*. 9999  ,  P=20  (  COVARIANCE  MATRIX  ORDER  ) 

K=25  (  COVARIANCE  SAMPLE  SIZE  ) 
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11  n:  STATISTICS  OF  SNR  ARE:  — -  CONFIDENCE  BOUND  FOR  EACH 

MEAN  -  ,y(iS  HISTOGRAM  DIN  BASED  ON  THE  ESTIMATED 

STANDARD  DEVIATION  -  4.J9K-2  STANDARD  DEVIATION  ABOUT  THE  EXPECTED 

BIN  FREQUENCY  USING  THE  BINOMIAL 
DISTRIBUTION 


nil:  S'!  AT  f  ST  ICS  OF  SNR  ARE :  -  CONFIDENCE  BOUND  FOR  EACH 

MEAN  =  .‘JO  5  f  IIISTOORAM  BIN  BASED  ON  THE  ESTIMATED 

STANDARD  DEVIATION  =  I.-I2E-2  '  STANDARD  DEVIATION  ABOUT  THE  EXPECTED 

BIN  FREQUENCY  USING  THE  BINOMIAL 
DISTRIBUTION 


THE  STATISTICS  OF  SNR  ARE:  -  CONFIDENCE  BOUND  FOR  EACH 

MEAN  =  .967  HISTOGRAM  BIN  BASED  ON  THE  ESTIMATED 

STANDARD  DEVIATION  =  3.97E-2  STANDARD  DEVIATION  ABOUT  THE  EXPECTED 

BIN  FREQUENCY  USING  THE  BINOMIAL 
DISTRIBUTION 
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THE  STATISTICS  OF  SNR  ARE:  . —  -  CONFIDENCE  BOUND  FOR  EACH 

MEAN  =  .965  HISTOGRAM  BIN  BASED  ON  THE  ESTIMATED 

STANDARD  DEVIATION  -  I.IOE-J  STANDARD  DEVIATKIN  YBOlJT  Till:  EXPECTED 

IHN  FREQUENCY  USING  THE  BINOMIAI 

distribution 


ig.  4)  HISTOGRAMS  OF  SNR  FORMULA  (1.10)  BASED  ON  300 
INDEPENDENT  TRIALS  FOR  THE  CASE  WHEN  THE  NOISE 
CONSISTS  OF  A  l’st  ORDER  AUTOREGRESSIVE  COMPONENT 
PLUS  A  WHITE  NOISE  COMPONENT.  BOUNDS  ARE  PLACED  ON 
THF  EXPERIMENTALY  OBTAINED  BIN  FREQUENCIES,  ASSUMING 
THAT  SNR  HAS  THE  DERIVED  SNR  DENSITY  (3. 25)  AND 
THEN  CALCULATING  THE  EXPECTED  VALUE  AND  ESTIMATED 
STANDARD  DEVIATION  OF  THE  BIN  FREQUENCY.  HISTOGRAMS 
ARE  GENERATED  USING  30  EQUALLY  SPACED  BINS.  THE 
EXPERIMENTAL  PARAMETERS  ARE: 

a= . 9999  ,  p=20  (  COVARIANCE  MATRIX  ORDER  ) 

K=25  (  COVARIANCE  SAMPLE  SIZE  ) 


o 


O 

O 

UJ 

UJ 

F 

u 

F 

CJ 

UJ 

cu 

x 

x 

H-4 

X 

< 

OS 

F 

UJ 

HH 

0 

00 

2 

X 

UJ 

UJ 

0 

X 

2 

0£ 

Q 

UJ 

F 

HH 

2 

2: 

i£ 

CQ 

CO 

2) 

F 

O 

X 

X 

X 

X 

2 

O 

X 

< 

c 

O 

CQ 

t— 

F 

x 

t: 

CJ 

O 

0 

x 

2: 

UJ 

2 

2 

rr 

X 

CO 

O 

HH 

HH 

Q 

< 

H-4 

CO 

0 

H-4 

CQ 

c— 1 

X 

UJ 

x 

< 

G- 

2 

2 

HH 

F 

X 

O 

HH 

> 

U 

2 

X 

U 

CQ 

UJ 

2 

C 

O 

X 

1 — * 

1 

X 

F 

l 

§ 

Q 

c/x 

1 

X 

X 

1 

3 

< 

ry'. 

Hh 

1 

0 

a 

X 

X 

1 

X 

2 

X 

1 

C/3 

< 

2 

CO 

l 

HH 

F 

HH 

HH 

I 

X 

CO 

X 

- — \ 

X 

co 

HH 

o 

2: 

o 

X  r— t 

F  • 

h-4  II 


X 

X 

s 

.  , 

X 

F 

X 

CM 

CO 

CJ 

< 

t 

X 

2 

X 

X 

X 

VO 

X 

X 

rv* 

O'  2 

• 

X 

X 

CO 

fv. 

co 

X 

H—i 

X 

II 

0 

X 

2 

X 

0 

2 

< 

O 

2 

HH 

X 

O 

CO 

F 

< 

HH 

u 

< 

CO 

HH 

HH 

F 

> 

X 

co 

X 

X 

HH 

to 

c 

Q 

F 

X 

X 

X 

< 

• 

c 

O 

X 

F 

QtS 

X 

11 

< 

LQ 

Q 

■M 

II 

2 

2 

CO 

X 

X 

< 

< 

— 

2 

X 

X 

F 

r-H 

HH 

F 

X 

CO 

*-r 

do 

■  H 

x 


X  O 


o 

o 


Fig.  5)  HISTOGRAMS  OF  SNR  FORMULA  (1.10)  BASED  ON  500 
INDEPENDENT  TRIALS  FOR  THE  CASE  WHEN  THE  NOISE  BEING 
USED  TO  ESTIMATE  THE  COVARIANCE  MATRIX  IS  CONTAMINATED 
BY  SIGNAL.  BOUNDS  ARE  PLACED  ON  THE  EXPERIMENTALY 
OBTAINED  BIN  FREQUENCIES,  ASSUMING  THAT  SNR  HAS  THE 
DERIVED  DENSITY  (5.25)  AND  THEN  CALCULATING  THE  EXPECTED 
VALUE  AND  ESTIMATED  STANDARD  DEVIATION  OF  THE  BIN 
FREQUENCY.  HISTOGRAM  IS  GENERATED  USING  50  EQUALLY  SPACED 
’BINS.  THE  EXPERIMENTAL  PARAMETERS  ARE: 

a= . 9999  ,  o=20  (  COVARIANCE  MATRIX  ORDER  ) 

K=25  (  COVARIANCE  SAMPLE  SIZE  ) 
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Fig.  6a)  THEORETICAL  EXPECTED  VALUE  OF  SNR  F'OR  TWO  METHODS  OF 

DATA  DEPENDENT  SNR  IMPROVEMENT  :  INR=10  dB,  f=.03  ,  p=20  ,  d=.9999 

-  USING  FILTER  WEIGHTS  BASED  ON  THE  PRINCIPAL  EIGENVECTOR  (I. 15) 

-  USING  FILTER  WEIGHTS  BASED  ON  THE  INVERSE  OF  THE  ESTIMATED 

COVARIANCE  MATRIX  (1.09) 
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Fig.  7b J  THEORETICAL  PROBABILITY  DENSITY  OF  SNR  FOR  IWO  METHODS  OF 

DATA  DEPENDENT  SNR  IMPROVEMENT  :  INR=lO  DB  ,  t-=,03,  K=35  ,  1=20  ,r*=.9 

-  USING  FILTER  WEIGHTS  BASED  ON  THE  PRINCIPAL  EIGENVECTOR  (1.15) 

-  USING  FILTER  WEIGHTS  BASED  ON  THE  INVERSE  OF  THE  ESTIMATED 

COVARIANCE  MATRIX  (1.09) 
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using  filter  weights  based  on  run  principal  eigenvector  (i.is) 

USING  II LTHR  WEIGHTS  BASED  ON  THE  INVERSE  OF  THE  ESTIMATED 
COVARIANCE  MATRIX  (1.09) 


THEORETICAL  PROBABILITY  DENSITY  OF  SNR  FOR  TOO  METHODS  OF 

DATA  DEPENDENT  SNR  IMPROVEMENT  :  INR=10  dB  ,  f=.03  ,  K=65  ,  p=20  ,  a=.9999 

-  USING  FILTER  WEIGHTS  BASED  ON  THE  PRINCIPAL  EIGENVECTOR  (1.15) 

-  USING  FILTER  WEIGHTS  BASED  ON  THE  INVERSE  OF  THE  ESTIMATED 

COVARIANCE  MATRIX  (1.09) 
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